Skip to main content

Reply to this post | See parent post | Go Back
View Post [edit]

Poster: KlangenFarben Date: Jul 6, 2012 6:41pm
Forum: web Subject: Re: Do crawls get deleted?

I can certainly attest to the phenomena of previously available TWBM crawls that became unavailable sometime in the past year or two. I launched in late November 2008, and shortly thereafter subscribed to's crawl list. By 2010 there were at least three crawls, but currently there's a single crawl that's sixteen months old; not much has changed since then (mostly deletions), suggesting some heuristic was at work. I'm not challenging Anamon's account but rather relating my perception of how TWBM works.

Anamon second paragraph does accurately reflect what happened to the once-well-crawled, which I operated for three years or so 1997-1999 and perhaps later. When I first heard of TWBM around 2004-2006, I immediately checked and was astonished to find at least three and perhaps as many as six crawls. The removal request is clear, but as I am a data hoarder I posted a copy of the old site on my current site, so--outside of loss of proof of previous ownership--no harm done, and clearly no complaints as I've never been asked much less assisted with TWBM.

At any rate, it's Good To Know some of the inner workings of TWBM.

cheers klang